Analytical results for a Fokker— Planck equation in the small noise limit 
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We present analytical results for the lowest cumulants of a stochastic process described by a 
Fokker-Planck equation with nonlinear drift. We show that, in the limit of small fluctuations, the 
mean, the variance and the covariance of the process can be expressed in compact form with the help 
of the Lambert W function. As an application, we discuss the interplay of noise and nonlinearity 
far from equilibrium. 
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I. INTRODUCTION 

The Fokker-Planck equation is a basic equation in the 
theory of stochastic processes. Since its introduction by 
Adriaan Fokker (1914) and Max Planck (1917) at the 
beginning of the last century, it has become a very use- 
ful tool for characterizing the time evolution of systems 
subjected to fluctuations and noise [lj. The Fokker- 
Planck equation is a partial differential equation of first 
order in time for the probability density function in po- 
sition P{x, t) of the system. By definition, the quantity 
P(x,t) dx is the probability to find the position of the 
system in the interval [x, x + dx] at time t. In one dimen- 
sion, the Fokker-Planck equation takes the form 



dP(x,t) d 



where K (x) is the drift and D the diffusion coefficient 0- 
These two quantities have a simple physical interpreta- 
tion. The drift coefficient, K (x) = —U'(x), corresponds 
to the force experienced by the system moving in the 
external potential U(x). It describes the deterministic 
component of the dynamics, that is, the evolution in the 
absence of fluctuations. On the other hand, the diffu- 
sion constant D measures the intensity of the noise and 
represents the stochastic part of the diffusion process. 

The Fokker-Planck equation is not solvable ana- 
lytically for arbitrary nonlinear drift coefficients K(x). 
Closed-form solutions for the probability distribution 
P(x, t) are only known for very simple forms of the drift 
term [l|. One example is the Wiener process which de- 
scribes a free particle in the presence of noise. Here the 
drift coefficient vanishes and Eq. reduces to the sim- 
ple diffusion equation. Another exactly solvable example 
is a noisy harmonically bound particle which corresponds 
to a linear drift, K(x) — —ax. This random process is 
known as the Ornstein-Uhlenbeck process. In the gen- 
eral case, however, approximate solution methods are 
essential for practical applications. Among these, the 
small noise approximation is an important approxima- 
tion scheme which can be applied when the fluctuations 
are weak. In this case, the dynamics of the system is 
mostly governed by the drift term and the noise can be 
treated as a small perturbation. As a result, one can ob- 
tain approximate expressions for the lowest cumulants of 
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d 2 P{x,t) 



(1) 



the probability density function, such as the mean and 
the variance of the stochastic process. However, in or- 
der to be usefully implemented, the small noise expan- 
sion requires the analytical solution of the deterministic 
equation, x(t) = K(x), in the absence of noise. Unfortu- 
nately, an exact solution of this equation is usually not 
available. 

The purpose of this paper is to present a simple, yet 
non trivial, example where the small noise approximation 
can be implemented analytically. Specifically, we shall 
consider Eq. with the nonlinear drift coefficient 



K(x) 



(2) 



Fokker-Planck equations of this type appear in the 
semiclassical description of a very efficient laser cooling 
method known as Sisyphus cooling HH|. The 1997 No- 
bel prize was awarded to Steven Chu, Claude Cohen- 
Tannoudji and William Phillips for the development of 
these new laser cooling methods. In addition, these ordi- 
nary Fokker-Planck equations play an important role in 
the investigation of unusual statistical mechanical prop- 
erties of cold atoms, such as ergodicity breaking j5j- As 
we shall see, the solution of the deterministic equation 
of motion with the drift coefficient J2J can be expressed 
cxplicitcly in terms of the Lambert W function. The 
Lambert function, named after Johann Hcinrich Lam- 
bert (1728-1777), is the solution of the transcendental 
equation W(x) exp[W(x)] = x The function W(x) 
can thus be viewed as a simple generalization of the log- 
arithm. It has recently been realized that many physical 
problems can be solved analytically using the Lambert 
function, making their analysis more tractable. Exam- 
ples include problems from electrostatics and quantum 
mechanics 0j_gravitational Q and statistical physics 0, 
astrophysics [T(| and classical mechanics [fj|. Here we 
show that the Lambert W function can also be used with 
profit in the study of stochastic processes. 

This paper is organized as follows. In Section II, we 
briefly review the small noise expansion and derive an 
approximate Fokker-Planck equation in the limit of zero 
fluctuations. In Sections III and IV, we analytically com- 
pute the mean, the variance and the covariance of the 
random process defined by Eqs. Q and J2J) in the limit of 
small noise. We take advantage of the Lambert function 
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to express these quantities in a compact way. Finally, 
we use these explicit results to illustrate the complex be- 
havior that arises due to the interplay of nonequilibrium 
fluctuations and nonlinearity of the drift. In particular, 
we show that the effect of the noise can be greatly en- 
hanced by the nonlinearity. 



II. SMALL NOISE APPROXIMATION 

The small noise approximation is based on the follow- 
ing observation: In the limit D — > 0, where fluctuations 
are very small, the time evolution of the system is mainly 
determined by the deterministic trajectory that corre- 
sponds to D — 0. The stochastic trajectory of the system 
with noise can then be expanded around the determinis- 
tic solution. In this way, one obtains an expansion of the 
Fokker-Planck equation in powers of \[D [l2l . We 
begin with the zero noise equation 

?E!sA = -§- yK{x) P {xM , (3) 

with K(x) given by Eq. I|2|l. The corresponding deter- 
ministic equation for the position x(t) of the system can 
be shown to be 



x(t)=K(x) = -- 



(4) 



An analytical solution of this nonlinear differential equa- 
tion can be obtained by introducing the variable z = x 2 . 
After integration, we find that z(t) satisfies 



ze 



-2t+C 



(5) 



where C = zq + lnzo is the integration constant. We 
recognize in Eq. (jjjj the defining equation of the Lambert 
function and we can therefore write 



z(t) = W[e 



-2t+C] 



(G) 



As a result, the solution of the deterministic differential 
equation which we denote in the following by x(t), 
is given by a square root of the W function, 



x{t) = ±«/W[e-»+°l 



(7) 



A typical positive trajectory of this deterministic process 
is shown in Fig. 0). We observe that, as time evolves, 
the system approaches the stable minimum, x = 0, of 
the external potential U(x) = 1/2 ln(l + x 2 ). By us- 
ing the asymptotic expansions of the Lambert function 
for small and large arguments, W[x] ~ x for x <C 1 
and W[x] ~ In x for x ^> 1, we can deduce the be- 
havior of the deterministic trajectory x{t) for small and 
large times. For small times, we have x(t) ~ \J — 2t + C. 
This nonexponcntial time dependence corresponds to the 
nonlinear part of the drift coefficient J5J . On the other 
hand, for large times, we obtain an exponential decay, 



x(t) ~ exp[— t + C/2], a behavior which is reminiscent of 
that of an Ornstein-Uhlenbeck process. In this regime, 
the system is close to the origin of the potential and ex- 
periences the linear part of the drift. 



o 



FIG. 1: Deterministic trajectory x(i), Eq. 10, in the absence 
of noise, with C = 3 (continuous line). The dashed line rep- 
resents the exponential approximation valid for large times. 

Having determined the deterministic trajectory in the 
absence of noise, the next step is now to expand the ran- 
dom trajectory x(t), in the presence of weak fluctuations, 
around the deterministic path x(t) . In first order of the 
small expansion parameter \f~D, we write 




x(t) =x(t) + VDy(t) 



(8) 



Equation (JHJ defines a new random variable y(t) with 
probability density function Q(y,t). By noting that 
Q(y, t) — P(x, t), it is straightforward to derive a Fokker- 
Planck equation for the distribution Q(y, t) from Eq. QJ. 
This yields 

2^2 I „«,,«,, + (9) 

where we have used the first order expansion, K(x + 
VD y) ~ K (x) + y/DyK'(x). In the limit of small fluc- 
tuations, the Fokker-Planck equation with nonlinear 
drift is thus transformed into the Fokker-Planck equa- 
tion with a linear, time dependent, drift coefficient, 
K'(x(t))y. This is an important point since the lowest 
cumulants of a time dependent Ornstein- Uhlenbeck pro- 
cess can be calculated in closed form. 



III. MEAN AND VARIANCE 

In this Section, we use the just derived Fokker-Planck 
equation @ with linear drift to evaluate the lowest cumu- 
lants of the random variable x(t) within the small noise 
approximation. The moments (x n ) are defined by the 
general formula 



0=/^(M) 



(10) 
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Of main interest are the first two moments of the dis- 
tribution P(x,t), from which we can calculate the first 
two cumulants. The first cumulant, the mean (x), de- 
scribes the average displacement of the probability dis- 
tribution, whereas the second cumulant, the variance 
a 2 = (x 2 ) — (x) 2 , is related to the spreading of the distri- 
bution due to the noise. It is a simple task to obtain to 
first two cumulants of x(t) from those of the new variable 
y(t) using Eq. ©. We find, 



D(y) , 



Da 2 y 



(11) 
(12) 



The mean (x) is hence the sum of the deterministic pro- 
cess x(t) and a small contribution \f~D {y) coming from 
the noise, while the variance a 2 is simply proportional to 
the variance a 2 . 

Let us now evaluate the lowest cumulants of the 
stochastic variable y(t). The time evolution of the cu- 
mulants of y(t) is fully determined by the Fokker-Planck 
equation JHJ. For the first two cumulants, we have 0] 



K'(x) (y) 



dt 

dp?, ,, s t 



(13) 
(14) 



A direct consequence of the linearity of the drift coeffi- 
cient in Eq. © is that the above equations are closed for 
(y) and a 2 . These first order differential equations can 
therefore be solved, 

(y)(t) = exp 



dt! K'(x(ti)) 



(15) 



a 2 y {t) = 2 exp 



dhK'ixih)) 



dti exp 



dt 2 K'(x(t 2 )) . (16) 



We stress that for general nonlinear drift coefficients 
K(x), these formal integrals cannot be evaluated explic- 
itly. However, in the present situation, we can use the 
deterministic solution (JJJ) to obtain the compact expres- 
sions 



(»>(*) = 



K{x) 
K(x ) ' 
2x- 2 + (xf ) 



12t - 2Xn 



x 4 



(17) 



K(x) 2 ,(18) 



where xq is the initial position of the system. We can 
easily verify that Eqs. I|17|) and i|18|) reduce to the known 
results of the Ornstein-Uhlenbeck process when xq — > 0, 



{y)(t)ou = exp[-t] , 
<J 2 v (t)ou = l-exp[-2t] 



(19) 
(20) 



In this limit, the system initially starts close to the bot- 
tom of the potential and only feels the linear part of 



drift. The general nonexponential time dependence of 
Eqs. I|17fl -ill8 [) thus directly reflects the nonlinear nature 
of the problem. Moreover, Eqs. 1)17 — 1|18| ) also simplify 
in the limit of long times, when the system again ap- 
proaches the origin. Using the asymptotic properties of 
the Lambert function, we find for large times 



(y)(t) 



exp[— t] 
K(x ) ' 
1 + 6t exp[ 



-2*1 



(21) 
(22) 



Note that in this long time limit, the stochastic process 
does not exactly reduce to an Ornstein-Uhlenbeck pro- 
cess. 




Time t 



FIG. 2: Average contribution of the noise {y(t)) as given by 
Eq. 1171 for two initial conditions: a) C — 0.8 (dotted line) 
and b) C = 8 (continuous line). 
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Time t 



FIG. 3: Variance ffy(t) of the noise contribution, as given by 
Eq. I)18|l . for C = 3 (continuous line). The dashed line shows 
the variance (Jy(t)ou (|20|> of the Ornstein-Uhlenbeck process. 



It is worthwhile noticing that x — 1 is an inflexion 
point of the potential U(x) — 1/2 ln(l + x 2 ): the func- 
tion U(x) is concave for x < 1 and convex for x > 1. 
This leads to the interesting result that the influence of 
the fluctuations on the system depends on whether the 
initial position xq is smaller or larger than one, as illus- 
trated in Fig. (J2J. For xq < 1 (or equivalently C < 1), 
the time derivative d(y)/dt in Eq. I|13|) is always nega- 
tive and the average contribution of the noise (y){i) to 
the stochastic trajectory in Eq. l|llf> steadily diminishes 
with time. By contrast, for xq > 1 (or C > 1), the time 
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derivative is first positive for t < tc = (C — 1)/2 and then 
changes sign. Therefore, the contribution of the fluctua- 
tions to the averaged dynamics first increases with time, 
reaches a maximum at t — tc and then decreases rapidly. 
We thus have a transient situation where fluctuations ac- 
tually push the system away from the deterministic mo- 
tion. Such an effect does not exist for processes with 
linear drift. This noise amplification is hence a direct 
consequence of the nonlinearity of the drift coefficient. 

No such initial condition dependence is observed for 
the variance cr^(t). For all initial positions Xq, the vari- 
ance diplays a similar behavior, as shown in Fig. 
the variance first increases linearly with time and then 
decays exponentially to one — the saturation of the vari- 
ance for large times corresponding to the stationary limit 
where the effect of the fluctuations is counterbalanced by 
the confining potential U(x). However, as for the mean 
(y){t), a signature of the amplification of the noise by 
the nonlinearity is clearly visible. We note indeed that 
contrary to the Ornstein-Uhlenbeck process, where the 
variance l|2U|) is always smaller than one, the variance 
here largely exceeds the value one. This amplification is 
found to be stronger the larger the value Xq. In other 
words, the noise amplification is stronger, the farther the 
system initially starts from the linear regime. 




2 4 6 8 

Time difference X 

FIG. 4: Autocorrelation function g y (t,t + r) of the random 
variable y(t), Eq. 12611 . as a function of the time difference r 
for fixed time t = 1. The continuous line corresponds to an 
integration constant C = 8 and the dashed line to C = 0.8. 



IV. AUTOCORRELATION FUNCTION 

We next calculate another quantity of great inter- 
est, namely, the autocorrelation function (or covariance), 
g x (t,s) = (x(t)x(s)) — (x(t))(x(s)), which measures the 
time correlations of the process x[t) between different 
times t and s. In the limit t = s, the covariance reduces 
to the variance g x (t,t) = o x (t). Similar to the variance, 
the covariance g x (t, s) is simply related to the covariance 
g y (t, s) through g x (t, s) — D g y (t, s). The time evolution 
of the autocorrelation function g y (t, s) for the stochastic 
variable y{t) can easily be determined from the Fokker- 
Planck equation © and we have [b"H 



dg y (t, 

ds 



It is interesting to note that this differential equation 
for the covariance g y (t,s) is identical to the differential 
equation (|13Jl for the mean (y)(t). This is an example of 
a regression theorem for a stochastic process with linear 
drift, where the one-time and two-time correlation func- 
tions obey the same evolution equation |l2j . The solution 
of Eq. J23J) reads 



g y (t,s) = (jy(i)exp 



K(x(t)) ' 



(24) 



where the variance & y {t) is given by Eq. (|18J) . In the 
limit Xo — > 0, Eq. (|24[l reduces to the familiar Ornstein- 
Uhlenbeck result 



9y(t, s) 



ou 



(I - exp [-2t]) exp [- (s - t)] 



(25) 



as it should. In the limit of long times, the process be- 
comes stationary and the covariance depends only on the 
time difference t = s — t, 



g y (t,s) ~ exp [- (s - <)] 



(26) 



K'(x(s)))g y (t, 



(23) 



Equation (|26|l indicates an asymptotic exponential decay 
of the time correlations. The behavior of the autocorre- 
lation function for short times is however different, as 
shown in Fig. (@J). In analogy with the mean, two sit- 
uations have to be distinguished, depending on whether 
xq is smaller or larger than one. For xo < 1, the time 
correlation function g y (t, t + r) always decreases with in- 
creasing time difference r. By contrast, when xo > I, 
the covariance first increases for small t before decreas- 
ing for larger time differences. We thus have temporary 
enhancement of the temporal correlations of the random 
process. This is another unexpected consequence due to 
the nonlinearity of drift term. 

V. CONCLUSION 

In summary, we have obtained explicit results for the 
mean, the variance and the covariance of a stochastic pro- 
cess described by a Fokker-Planck equation with nonlin- 
ear drift in the small noise approximation. We were able 
to write down compact analytical expressions for these 
physical quantities by using the Lambert W function. 
This is hence an example of a random process whose 
study is notably facilitated by the use of the Lambert 
function. Moreover, we have found that, far from equi- 
librium, the nonlinearity of the drift leads both to a tran- 
sient amplification of the noise and to a transient increase 
of the temporal correlations. These effects illustrate the 
rich behavior that can result from the interplay of noise 
and nonlinearity. 

We acknowledge financial support from the Landess- 
tiftung Baden- Wurttemberg. 
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